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SUMMARY 


Principal  results  obtained  during  the  contract  period  were  In  the 
fol lowing  areas: 

1)  Information  capacity  of  stationary  Gaussian  channels; 

2)  Information  capacity  of  Gaussian  channels  subject  to  jamming: 

3)  (Capacity  of  Poisson  and  Poisson-related  channels; 

•4)  Coding  capacity  of  dimension-limited  channels; 

5) .  Absolute  continuity  and  channel  capacity  for  problems  Involving 

Gaussian-mlxture  noise; 

6)  Further  development  of  new  algorithms  for  signal  detection; 

7)  Computational  evaluation  of  both  new  and  classical  algorithms  for 
detection  of  signals  in  noise,  with  comparisons  and  results; 

8)  Analysis  and  modeling  of  passive  sonar  data; 

9)  Representation  of  stochastic  processes. 

Two  of  the  PI*s  students  received  the  Ph.D.  In  Statistics  during  this 
p>erlod:  both  were  supported  In  part  by  grant  funds.  In  addition,  five  other 
graduate  students  received  some  financial  support  from  the  grant,  primarily 
for  work  associated  with  the  computational  work  on  tasks  7)  and  8)  above. 

As  can  be  seen  from  the  above  list  of  topics,  tmd  more  clearly  from  the 
remaining  parts  of  this  report,  the  principal  thrust  of  the  research  carried 
out  under  the  gremt  has  been  on  capacity  of  noisy  communication  channels  and 
on  nonGausslein  signal  detection  problems.  Our  work  has  differed  from  all 
other  work  known  to  us  In  two  resp>ects: 

a)  For  channel  capacity,  our  emphasis  Is  on  general  continuous-time 
channels  or  Inflnlte-dlmensIonal  discrete-time  channels; 
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b)  For  signal  detection,  we  emphasize  a  rigorous  mathematical  solution 
of  the  underlying  continuous- time  problem,  develop  discrete-time 
algorithms  based  on  those  solutions,  then  computationally  evaluate 
the  algorithms  using  both  simulated  data  and  experimental  data 
obtained  from  operational  systems. 

So  far  as  we  know,  all  work  published  during  the  p>ast  15  years  In  these 
two  areas  which  has  all  of  the  above  characteristics  has  emanated  from  our 
research  program.  This  includes  work  not  only  by  the  PI,  but  by  his  students 
and  by  a  number  of  colleagues  In  Japan  and  Europe.  The  research  supported  by 
this  grant  has  continued  the  previous  work.  2ind  the  continuity  of  funding 
provided  by  ONR  has  been  extremely  Impor taint  In  enabling  us  to  obtain  the 
results  described  below. 

The  results  In  each  of  the  nine  areas  listed  above  are  very  briefly 
described  in  the  next  section. 


DISQJSSION  OF  MAIN  RESULTS 

1.  Information  Capacity  of  Stationary  Gaussian  Channels  [15]. 

This  Is  one  of  the  principal  areas  of  research  in  the  Shannon  theory.  A 
partial  solution  was  obtained  In  [1].  The  solution  obtained  In  our  work  [15] 
Is  far  more  general.  For  Gaussian  channels  having  noise  with  rational 
spectral  densities,  our  results  provide  a  complete  solution  to  the  Information 
capacity  problem.  This  Includes  an  Indepiendent  proof  of  the  results  of  [1] 
for  noise  having  a  rational  spectral  density. 
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2.  Information  Capacity  of  Gaussian  Channels  Subject  to  .Teunmine  [8],  [9]. 

The  channels  considered  in  this  work  are  "matched";  In  t'^e  absence  of 
jamming,  the  constraint  on  the  transmitted  signal  Is  given  In  terms  of  the 
noise  covariance.  CXir  interest  is  primarily  in  channels  with  memory, 
especially  Inf Inlte-dlmenslonal  channels  (e.g. ,  continuous- time  channels  with 
memory) . 

One  result  obtained  In  this  work  is  that  use  of  a  jammer  constraint 
commonly  employed  In  engineering  analysis  of  f Inlte-dlmenslonal  channels  is 
too  strong  to  be  meaningful  when  used  for  the  Infinite-dimensional  channel: 
the  jammer  cannot  decrease  the  capacity  of  the  channel,  regardless  of  his 
available  energy.  A  more  realistic  constraint  on  the  jammer  was  determined, 
and,  as  this  constraint  was  not  previously  applied  in  previous  published  work, 
the  jamming  problem  was  solved  for  both  finite-dimensional  and  infinite- 
dimensional  channels. 

3.  Capacity  of  Poisson  and  Poisson-Related  Channels  [11],  [16]. 

Poisson  channels  are  of  particular  interest  in  optical  communications. 
The  continuous-time  problem  was  modeled  eind  the  information  capacity  obtained 
for  the  case  of  random  or  time-varying  noise  intensity.  Bounds  were  obtained 
on  the  increase  in  capacity  obtained  with  causal  feedback.  A  class  of  jamming 
problems  was  considered,  and  the  optimal  jamming  signal  determined.  Results 
on  coding  capacity  were  obtained.  The  results  given  in  [16]  provide  a  compact 
unification  of  several  seemlngly-dlsparate  results  on  capacity. 

4.  Coding  Capacity  of  Dimension-Limited  Additive  Channels  [10],  [13]. 

This  work  applies  to  communication  ch2innels  where  the  dimensionality  of 
the  code  word  set  is  a  part  of  the  signal  constraint.  A  complete  solution  of 
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the  coding  capacity  problem  was  obtained  for  Gaussian  channels,  and  upper 
bounds  on  capacity  for  a  class  of  nonCausslan  channels.  These  results 
contain,  as  special  cases,  solutions  to  coding  capacity  for  the  classical 
discrete-time  Caussiein  channel,  and  coding  capacity  for  a  class  of  continuous¬ 
time  Gaussian  chzinnels. 

5.  Absolute  Continuity  and  Channel  Capacity  for  Problems  involvine 
Gausslan-Hlxture  Noise  [I?],  [18]. 

Gausslan-mixture  noise  Is  of  the  form  N  =  AG.  where  G  is  a  Gaussian 
process  and  A  is  a  non-negative  random  variable  Independent  of  G.  Such  a 
process  is  frequently  used  to  model  noise  arising  in  sonar  applications.  In 
[17].  the  absolute  continuity  problem  is  considered:  conditions  for  the 
likelihood  ratio  to  exist  between  a  process  Y  (e.g. ,  slgnal-plus-nolse)  and  a 
Gaussian  mixture  noise  process  N.  A  solution  is  obtained,  and  expressions  for 
the  likelihood  ratio  obtained.  These  results  are  then  applied  to  obtain  the 
information  capacity  of  a  communication  channel  perturbed  by  additive  Gaussian 
mixture  noise. 

6.  Further  Development  of  New  Algorithms  for  Signal  Detection  [14].  [18]. 

This  work  was  based  on  the  mathematical  results  contained  in  [2]  and 
[17].  A  preliminary  description  of  the  algorithms  for  detection  in  Gaussian 
noise  was  given  in  [3].  The  treatment  in  [18]  is  far  more  complete  and 
includes  several  new  results.  These  Include,  for  example,  algorithms  for 
detection  in  Gausslan-mixture  noise. 

The  49-page  paper  [18]  was  solicited  in  1989  for  Inclusion  in  a  book  to 
be  published  in  1990.  The  latest  estimate  is  that  the  book  will  be  published 
in  1993.  One  of  the  editors  of  this  book  has  been  Principal  Investigator  of 
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an  SBIR  contract  on  detection  of  nonGaussian  signals  in  Gaussian  noise  (the 
Phase  II  contract  now  being  in  progress).  He  has  commented  to  the  PI  that  the 
development  In  [183  was  viewed  as  "the  most  promising"  approach,  based  on  his 
company’s  Phase  I  survey  of  applicable  methods.  The  Phase  II  contract  is 
apparently  an  extension  to  arrays  of  the  computational  evaluations  described 
in  [H]. 

7.  Computational  Evaluation  of  both  New  and  Classical  Algorithms 
for  Signal  Detection  [14]. 

This  work  involved  the  use  of  simulated  data  zind  passive  sonar  data.  The 
prinary  objective  was  to  obtain  numerical  results  on  performance  of  new 
algorithms  described  in  [18]  and  [3],  and  to  compare  this  performance  with 
that  of  selected  reference  algorithms.  In  short,  the  new  algorithms  gave  very 
good  relative  performance.  The  relative  performance  should  increase  with  more 
realistic  data  sets  and  with  progress  on  optimizing  their  parameters. 

8.  Analysis  and  Modeling  of  Passive  Sonar  Data  [6],  [20]. 

This  work  Involved  statistical  testing  of  the  passive  sonar  data  used  to 
carry  out  the  evaluations  described  under  (7)  above.  It  was  found  that 
neither  the  noise  nor  the  signal -plus-noise  could  be  clearly  accepted  as 
Gaussian,  although  the  degree  of  non-normality  varied  with  the  frequency 
rauTge, 

Another  element  of  this  work  was  the  modeling  of  the  data  as  a  Gaussian 
mixture.  This  asp>ect  app>ears  to  have  some  potential  for  use  in 
classification. 

This  work  was  an  extension  and  refinement  of  earlier  work,  rep>orted  in 


[20]. 
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9.  Representation  of  Stoc?iastlc  Processes  [12],  [19]. 

The  mathematical  results  obtained  in  [2],  which  have  provided  the 
theoretical  foundation  for  the  promising  new  algorithms  described  in  [3]  and 
[18],  are  based  on  the  spectral  representation  of  second-order  stochastic 
processes,  and  also  maJce  use  of  reproducing  kernel  Hilbert  space  (RKHS)  theory 
at  key  points  of  the  development. 

The  tecfinical  reports  [12]  and  [19]  contain  a  development  of  the 
applicable  theory  in  these  two  areas.  The  RKHS  report  is  directed  toward 
readers  Interested  in  stochastic  processes. 
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